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Executive Summary 


The use of the Quality Rating and Improvement System (QRIS) to improve early childhood 
education program quality is based in part on assumptions that the quality of programs 
can be measured and that quality ratings are associated with meaningful differences in 
learning outcomes for children. This report reviews all of the state QRIS validation studies 
that examined associations between individual rating elements and child outcomes as 
well as other research that exists on four elements of the California QRIS, referred to as 
Quality Counts California: teacher qualifications, program environment, teacher—child 
interactions, and child-to-teacher ratio and group size. 


The review indicates that the current elements in Quality Counts California have weak and 
inconsistent associations with child outcomes. The problem is not necessarily with the 
dimensions measured but with how they are measured and with how points are allocated. 


There are a number of methodological reasons that could explain the weak associations 
found between teacher qualifications and child outcomes. Studies do not always 
differentiate programs serving different-aged children. Most studies were conducted 
previous to the increased expectations for preschool teachers’ skills and responsibilities. 
And studies do not examine the quality and content of courses or interactions between 
preparation and the support early childhood educators experience in their jobs. 


The current measures of program environment (ECERS) and teacher-child interactions 
(CLASS) may be weakly and inconsistently predictive of child outcomes because they do 
not assess practices that are directly related to the child outcomes assessed. Furthermore, 
if the current measures are used, greater validity might be achieved by adding points in 
the QRIS rating with smaller increases in scores at the top of the CLASS scale and at the 
bottom of the ECERS scale. The evidence suggests similarly that greater validity might be 
achieved for the child-to-teacher ratio and group size element by awarding more points 
for variations in the lower end (e.g., under 7.5 for child-to-teacher ratio and under 15 for 
group size) than for the same differences at the higher end. 


The report recommends: (a) developing a program observation measure that is better 
aligned to desirable child outcomes, including foundational academic skills; (b) creating 
a measure of teacher qualifications that includes the nature and extent of courses 

in early childhood education (ECE); (c) differentiating between programs that serve 
children of different ages; and (d) considering additional ratings related to the quality 

of work environment and pay. An examination of cutoff scores in rating rubrics and the 
use of more comprehensive measures of child outcomes in validation studies are also 
recommended. 
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DE] 
Introduction 


A primary lever for improving quality in early childhood education (ECE) programs is 
the Quality Rating and Improvement System (QRIS). QRISs are designed to assess program 
quality and provide support for improvement. Early childhood programs receive a quality 
rating based on a set of quality indicators and resources are provided to support quality 
improvement efforts. 


In 2011, California was awarded a federal Race to the Top—Early Childhood 
Education grant providing $75 million for the development of a statewide QRIS. In contrast 
to most other states, California opted to implement its QRIS locally, citing the state's 
diversity, size, and ongoing local quality efforts as rationale. From 2013 to 2016, California 
engaged in a pilot phase for QRIS implementation in 16 counties. California's QRIS is now 
being implemented on a voluntary basis in all counties across the state. 


California's QRIS is overseen by the California Department of Education and First 
5 California but is implemented at the county or regional level through locally operated 
QRISs. Additionally, there are 10 regional hubs encompassing all 58 counties; this allows 
for coordination of California QRIS implementation among counties. All counties agree 
to adopt a common QRIS framework and rating system but are given discretion to make 
certain local determinations within the common framework. 


The county consortium agreed-upon rating matrix consists of seven elements 
five for Family Child Care Homes [FCCHs]) organized into three core areas—Core 1: Child 
Development and School Readiness; Core 2: Teachers and Teaching; and Core 3: Program 
Environment. The seven elements include child observations; developmental and health 
screenings; minimum qualifications for lead teachers; effective teacher—child interactions; 
ratios and group sizes; program environment; and director qualifications. Based on a point 
system, programs are designated as being in one of five tiers (see Appendix). 


Participation in QRIS by early care programs is voluntary; programs serving low- 
income populations were prioritized during the piloting phase. As of September 2019, 
California had 10,576 daycare centers and 2,153 infant centers for a total of 12,729 licensed 
centers in the state. Of these, 4,068—31.9 percent—participated in QRIS. Of the 28,313 
FCCHs, 2,661—9.3 percent—participated (California Department of Education, 2020). 


The use of the QRIS to improve quality is based in part on assumptions that the 
quality of early childhood programs can be measured and that the quality represented 
by different scores is associated with meaningful differences in learning outcomes 
for children. Evidence for associations between QRIS ratings and children’s social and 
cognitive outcomes is weak. A careful analysis of common elements of QRISs might, 
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however, provide evidence on which dimensions of program quality are most predictive of 
child outcomes. This report reviews all of the state QRIS validation studies that examined 
associations between individual elements and child outcomes as well as other research 
that exists on four of the elements of the California QRIS. It also discusses measurement 
issues that may be limiting the value and the strength of associations with child outcomes 
for particular elements. The first section reviews QRIS validation studies and the second 
section reviews other research on four of the elements. 


QRIS Validation Studies 
Early Studies 


Between 2008 and 2012, in seven of the studies that were conducted to examine 
how well QRIS was functioning researchers examined associations between QRIS ratings 
and child outcomes. Three of these studies did not assess children’s development in the 
fall. As a consequence, any association between QRIS ratings and children’s development 
in the spring could be explained by other variables (e.g., more educated parents choosing 
higher quality programs). Studies in the other four states, however, did include a fall 
pretest. 


The findings for these four states were mixed (see Karoly, 2014). The study of 
Colorado (Zellman et al., 2008) found no significant associations between child outcomes 
and QRIS ratings or elements of QRIS. In Minnesota, QRIS ratings were not significantly 
associated with child outcomes (Tout et al., 2011) but there were a few scattered 
associations for specific subscores. Out of 37 analyses examining associations between 
Early Childhood Environment Rating Scale-Revised (ECERS-R) and Classroom Assessment 
Scoring System (CLASS) subscores, three were significant in the expected direction and 
one was significant in the opposite direction. 


The study of the Missouri QRIS (Thornburg et al., 2009), in contrast, found that QRIS 
ratings were significantly associated with children’s social skills, measured by the Devereux 
Early Childhood Assessment (DECA). The effect was explained primarily by two subscales: 
“initiative” (motivation, persistence) and “self-control” (Thornburg et al., 2009). Additional 
findings for children living in poverty showed significant associations between QRIS 
ratings and vocabulary skills; findings for children not living in poverty showed significant 
associations between QRIS ratings and children’s positive relationships with adults. 


The study of the Virginia QRIS also showed a few scattered significant associations 
between QRIS tiers and alphabet knowledge and phonological awareness (Sabol & Pianta, 
2015}. 
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Sabol and colleagues (2013) assessed associations between common elements 
in states’ QRISs and child outcomes using data from the National Center for Early 
Development and Learning (NCEDL) Multistate Study of Pre-Kindergarten and the Study of 
State-Wide Early Education Programs (SWEEP). They created a composite of the elements 
to roughly mirror QRIS ratings; these QRIS-like scores predicted prereading skills in only 
two of the nine states and social skills in only one of the states. Of the specific elements 
assessed (staff qualifications, including teacher and director level of education and years of 
experience; staff-to-child ratio and group size; family partnerships; learning environment 
measured by the ECERS-R; and interactions measured using CLASS), only the CLASS 
consistently predicted prereading, language, math, and social skills. 


Recent Studies 


In 2011, California submitted a successful Race to the Top—Early Learning Challenge 
(RTT—ELC) grant application to the U.S. Department of Education. States that received 
federal RTT—ELC funds were required to evaluate the validity of their QRIS. Seven states, 
including California, conducted pre—post child assessments in their evaluation and were 
thus able to assess associations between QRIS ratings and changes in children’s social and 
cognitive skills (Karoly et al., 2016; Magnuson & Lin, 2016; Maxwell et al., 2016; Quick et 
al., 2016; Soderberg et al., 2016; Tout et al., 2016; Wellesley Centers for Women & UMass 
Donahue Institute Applied Research & Program Evaluation, 2017). 


Table 1 summarizes the measures used to assess children on various developmental 
dimensions. Language and literacy were assessed more comprehensively—with at least 
two different assessments used in every state—than was math. The Woodcock Johnson 
Applied Problems subtest was used to assess math skills in all but one of the states. 
Overall, there is considerable overlap in child assessments used by the seven states. 
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California WJ-Letter Word ID WJ-Applied Peg/Pencil 
Story & Print Concepts Problems Tapping 
Delaware PPVT WJ-Applied HTKS DECA-Protective 
Wd-Letter Word ID Problems Factors & Behavior 
Concerns 
Massachusetts PPVT WJ-Applied DECA~-Total & PBLS Total 
Wd-Letter Word ID Problems Subscales (initiative, 
self-regulation, 
attachment, 
negative behavior) 
Minnesota TOPEL (print Knowledge, WJ-Applied Peg/Pencil Bracken School BMI SCBE PLBS (attention/ 
phonological awareness) Problems Tapping Readiness persistence) 
Picture Naming Subtest Assessment 
IGDI 
Rhode Island WJ-Letter Word ID WJ-Applied Peg/Pencil SCBE PLBS 
Wg Ill-Picture Vocabulary Problems Tapping 
Washington WJ-Letter Word ID TEAM HTKS Mullen Scales of Mullen Fine & CBCL 
PPVT TOQ Early Learning Gross Motor 
_ Scales (infants & 
pial Expressive toddlers) 
anguage 
Early Writing Assessment 
Pre-LAS 
Wisconsin W4J-Letter Work ID WJ-Applied HTKS Bracken School SCBE PLBS 
TOPEL (phonological Problems Readiness 
awareness) pssessinient 


PPVT: Peabody Picture Vocabulary Test 
HTKS: Head, Toes, Knees, Shoulder 
DECA: Devereaux Early Childhood Assessment 


TOPEL: Test of Preschool Early Literacy 


SCBE: Social Competence and Behavior Evaluation 


(social competence, anger/aggression, anxiety/withdrawal) 


PLBS: Preschool Learning and Behavior Scale 


IGDI: Individual Growth and Development Indicators 


TEAM: Tools for Early Assessment in Math 


CBCL: Child Behavior Checklist 
BMI: Body Mass Index 


TOQ: Task Orientation Questionnaire 
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Table 2 identifies the states in which significant associations between child 
outcomes and QRIS ratings and elements were found. In all of these analyses, pretest 
scores and gender were held constant; in some states, other variables known to be 
associated with the developmental outcomes assessed (e.g., family income, parent 
education, and child age) were also held constant. The QRIS elements are defined and 
assessed in different ways but tend to cluster into the categories shown in the table. Those 
that did not fit neatly into the categories are explained in the table footnotes. Empty cells 
occur when the association was not assessed (in most cases because the variable was 
not included in the study) or because the association was not significant in any state. 
State validation studies varied in the degree to which they differentiated early childhood 
settings (e.g., family vs. center) and age groups (e.g., infants and toddlers vs. preschoolers) 
in their analyses. When findings are reported separately, the differences are noted in the 
footnotes. 


The first row in Table 2 shows the states in which QRIS ratings were significantly 
associated with the child outcome indicated. Note that the associations were not always 
in the positive direction and in a few cases were found for one group of children but not 
another. Associations were not necessarily linear, with each point increase in rating being 
associated with an increment in the child outcome score. For example, in the case of 
Massachusetts, children in classrooms with the highest QRIS rating had higher Peabody 
Picture Vocabulary Test (PPVT) scores than did children in classrooms with the middle QRIS 
rating, but not higher than those of children in classrooms with the lowest QRIS rating. 


In every state, QRIS ratings were significantly associated with at least one assessed 
child outcome. In the case of California, QRIS ratings were significantly associated only 
with gains in executive function scores. QRIS ratings for two states—Rhode Island and 
Minnesota—were significantly associated with three different child outcomes. Looking 
across states, however, despite some significant associations, as Tout et al. (2017) 
concluded, “QRIS ratings were not strongly associated with patterns of children’s growth 
across the range of developmental skills assessed in the validation studies" (p. 52). 


A few State validation studies conducted additional analyses altering the method 
for computing the overall rating, for example by using different cutoff scores for allocating 
points on particular elements. In some cases, these additional analyses yielded a slightly 
different pattern of significant associations. For simplicity, the table shows the original 
analyses. The fact that modest changes in how the ratings were computed yielded 
somewhat different findings, however, suggests the value of investigating the relative 
validity of different computational strategies. 


The other rows in Table 2 summarize the significant associations between child 
outcomes and scores on individual elements of QRIS. 
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— Association was significantly negative. 


Notes. Significance limited to p < .05 or 
lower. Massachusetts did not provide 
evidence related to individual QRIS 
elements; Wisconsin assessed only ERS 
element. 
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Across the states, all the elements were positively associated with at least one 
child outcome assessed, although not necessarily in a positive direction. More significant 
associations with QRIS elements were found for language and literacy than were found for 
math. Possible reasons are that there were more measures used to assess language and 
literacy (from two to five) than were used to assess math (always one), and if a significant 
association was found for any of the language and literacy measures, the effect for that 
state was included in the table. Also, more attention is typically given to language and 
literacy than to math in early childhood education programs; this dimension may thus be 
more affected by program quality. 


California stands out as having the most negative associations between QRIS 
elements and child outcomes. The two observation measures—the teacher—child 
interaction measure (CLASS) and the environment rating scale (ECERS and its derivatives)— 
were negatively associated with gains in executive functions. The environment rating 
scale association with children’s language and literacy skills (story and print concepts) 
was uneven, with programs receiving 1, 2, or 4 points on that element being at about the 
same level and higher than programs receiving 3 or 5 points. The use of child assessments 
based on observations (mostly the Desired Results Developmental Profile, DRDP) was 
negatively associated with children’s executive functions; as scores on that element 
increased, children’s performance on the executive function measure decreased. The 
child observation element was also negatively associated with children’s performance on 
the story and print concepts measure; programs having the lowest scores on the element 
performed the best on the measure. 


The findings of state QRIS validation studies do not paint a clear picture of what 
aspects of early childhood programs are associated with desirable child outcomes. 
Associations between overall QRIS ratings, as well as specific elements, and child 
outcomes are inconsistent. There is, however, additional research, not specifically 
connected to QRIS, on associations between child outcomes and four of the same 
program quality indices included in California's and many other states’ QRIS that might 
provide a clearer picture of the most important elements to measure. We examine next 
findings on how well each of the following elements predict child outcomes: teacher 
qualifications, teacher—child interactions, classroom environment, and child-to-teacher 
ratio and group size. 
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Research on Elements 
Teacher Qualifications 


Many studies of childcare programs have found positive associations between 
more education and specialized teacher training in ECE and observed classroom quality 
(Burchinal et al., 2002; Cassidy et al., 2005; Lin & Magnuson, 2018; NICHD ECCRN, 2002; 
Phillips et al., 2000; Whitebook et al., 1989; for reviews see U.S. Department of Education, 
2010; Whitebook, 2003). A meta-analysis conducted by Manning et al. (2019) reported that 
of the 72 samples contained in 45 studies assessing associations between lead teachers’ 
or caregivers’ education (BA vs. not) and ECERS (or its derivatives), 36 showed positive 
effects of education. 


Studies have varied in the levels of teacher or caregiver education studied and 
which levels were found to make a difference. Cassidy et al. (2005), for example, found 
that associate's or bachelor’s degrees were associated with higher ECERS scores than high 
school and some college education. In contrast, Burchinal et al. (2002) and Whitebook 
et al. (1989) found significantly higher scores on the ECERS for caregivers with bachelor’s 
degrees than for caregivers with associate's degrees. 


The evidence supporting education, however, is not consistent. Some studies 
reported no effects of teacher education level, including a BA degree, on observed 
classroom quality (Early et al., 2006; Lin & Magnuson, 2018; Mashburn et al., 2008; 
Phillipsen et al, 1997). In an analysis of seven studies (Early et al., 2007), only two studies 
showed positive associations between teachers’ educational attainment and classroom 
quality, and one study found a negative association. 


Studies that examined children’s outcomes also yielded mixed results (see Zigler 
et al., 2011). Some found that higher levels of teachers’ education were linked to better 
school readiness skills. Burchinal et al. (2002), for example, found that a bachelor’s degree 
in ECE was associated with higher language scores in children; Early et al. (2006) found 
that children whose teachers held a BA had higher math skills than did children whose 
teachers held an associate's degree. Loeb et al. (2004) reported that education beyond a 
high school degree was associated with better cognitive skills in children. 


In contrast to these studies that found teacher education effects, in the 2013 study 
of nine states mentioned above, Sabol and colleagues found that staff qualifications, 
including teacher and director level of education and years of experience, did not 
predict any child outcomes in any state (see also Mashburn et al., 2008). Falenchuk et al. 
(2017) reported mixed findings from a meta-analysis of 39 studies. They reported some 
positive although weak associations between staff education and children’s language 
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outcomes (vocabulary and letter word identification) but no significant association with 
math (WJ-Applied Problems). Looking across all studies qualitatively, they concluded that 
“associations between staff education and childhood outcomes [were] non-existent to 
very borderline positive” (p. 1). 


A few studies suggested that the amount of early childhood content in a teacher's 
education may be more important than their level of education. For example, in the 
Phillips et al. (2000) study of center childcare programs, teachers’ specific training in ECE 
predicted higher ECERS scores in infant and toddler classrooms, but teachers’ education 
evels did not. Weaver (2002) found that providers with a degree in ECE or college 
coursework in ECE were rated higher in the quality of care in family childcare homes 
than were providers without college coursework in ECE. Snider and Fu (1990) reported 
that more ECE courses, in combination with supervised practice teaching, were strong 
predictors of teachers’ knowledge of developmentally appropriate practices, but level of 
education was not. Specifically, they found that the courses that differentiated teachers 
with high or low scores on a measure of their knowledge of developmentally appropriate 
practice focused on (a) planning, implementing, and evaluating developmentally 
appropriate content; (b) creating, evaluating, and selecting materials; (c) creating learning 
environments; (d) learning about curriculum models; and (e) observing and recording 
behaviors. 


One recent study employed a novel strategy for assessing teacher preparation (Lin 
& Magnuson, 2018)—that is, to use the registry level in the QRIS ratings for teachers, which 
included 17 steps that combined information on teachers’ education, major, credit-based 
courses, and credentials taken from reviews of transcripts. Analyses using the registry level 
as a continuous variable showed that additional levels were associated with an increase on 
the ECERS-R score. Additional analyses indicated that the positive association between the 
registry level and classroom quality was mainly driven by the difference between teachers 
with and without credit-based ECE training or credentials. 


Summary and analysis. |n both the QRIS validity studies and other studies in 
the research literature, the evidence on the value of credentials is inconsistent and also 
correlational, which makes causal conclusions risky. It is not, however, fair to conclude 
that the extent and nature of teacher preparation does not matter. There are many reasons 
for the inconsistency in results that have to do with the study methodologies and the 
timing of the research. 


First, studies often combined very different ECE contexts and different age groups. 
It is possible that the preparation required to be an effective childcare provider for infants 
and toddlers is not the same as the preparation required for preschool teachers and that 
mixing various ages and types of settings masks these specific effects. 
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Second, most of the studies were conducted prior to the increased emphasis 
on academic skill development, especially in preschool. At the time most studies were 
conducted, even teachers who had BAs in child development may not have been 
given instruction in teaching academic skills, in which case the program would not be 
expected to impact children’s reading and math skills. Likewise, if academic skills were 
not emphasized in the childcare or preschool programs in which graduates taught, they 
would not have the opportunity to apply any training they received in how to teach those 
subjects. Math, in particular, is given very little attention in preschools (Stipek & Johnson, 
2020), which would explain why teacher preparation might not have affected children’s 
math learning. 


Any effort to improve teacher preparation in California needs to consider current 
academic expectations in addition to social and other important domains of development. 
A study comparing the academic content of kindergarten in 1998 to that in 2006 showed 
that the amount of time kindergarten teachers spent on literacy learning activities 
increased by 25 percent (Bassok et al., 2016). To meet the more rigorous kindergarten 
standards, preschool teachers need to know how to ensure that children have the 
foundational academic skills they need at Kindergarten entry. 


Specific courses in subject matter teaching, which are currently rare in California 
higher education programs preparing preschool teachers, are needed to affect children’s 
academic learning. Research suggests, for example, that a methods course in the 
teaching of math may be necessary even for teachers to believe that math should be 
taught to preschool-age children (Platas, 2015). If teachers are not convinced that math 
iS appropriate for preschoolers, they are not likely to teach it, regardless of whether they 
have a BAor an AA. 


Third, the effect of preservice qualifications on child outcomes is most likely 
influenced by working conditions—especially the amount of support teachers receive 
on the job. Preservice preparation may not need to be as extensive if it is combined with 
apprenticeship experiences or strong mentoring on the job (Gardener et al., 2019). A study 
in California conducted by Vu and colleagues (2008) indicated that having a bachelor’s 
degree predicted quality in programs with relatively few resources and supports, such as 
community-based childcare, but did not predict quality in programs with more resources 
as well as Ongoing supports and monitoring, such as state-funded prek. 


A fourth reason why extant research provides limited guidance on effective 
teacher preparation is that most studies did not assess the quality or the nature of the 
courses taken. For example, studies did not differentiate between face-to-face and online 
courses, which may affect the quality of learning. Or, as is generally true of early childhood 
educator programs in California, they may have focused more on developing knowledge 
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about children than on developing the practical skills needed to promote children’s 
learning and development. Only one study was found that specifically examined the 
effects of clinical practice (Snider & Fu, 1990), which is considered by many experts to be 
a crucial component of teacher preparation (Darling-Hammond & Bransford, 2005). 


The number of courses taken in ECE may be particularly important, as suggested 
by a few studies reviewed above. One study found that the number of ECE courses 
teachers took was the most important predictor of classroom quality (Lin & Magnuson, 
2018). The number of ECE courses required for a BA that confers an ECE teacher license 
varies considerably among states. Studies conducted in multiple states could thus mask 
important differences in the content in BAs, even within ECE degree programs. 


More useful for guiding policies on degree requirements would be evidence on 
the content of courses and other experiences that support the development of effective 
teachers. 


Whitebook and colleagues (2009) provided excellent suggestions for identifying 
the central elements of productive teacher education. For example, they suggested 
differentiating between (a) foundational courses that cover theories of learning and 
development, the philosophy or history of education, and multicultural education; 

(b) pedagogical courses that focus on methods of teaching or classroom management in 
general, or as related to particular subject areas (e.g., how best to teach reading); and 
(c) content or subject matter courses (e.g., English or math courses). 


Pointing out that the quality of preparation goes beyond courses, they proposed 
three categories of training that should also be considered: (a) academic content that 
balances child development and pedagogy, and that emphasizes working with children 
from diverse cultural and linguistic backgrounds; (b) opportunities for practice and 
reflection through field placements; and (c) program structures that support both students 
and teacher educators as adult learners. 


In summary, if the goal is to have quality ratings that are associated with student 
learning, extant research Is too inconsistent and methodologically limited to support 
California's current allocation of QRIS points for teacher qualifications. It is not clear 
that the same requirements are desirable for early childhood educators who interact 
with infants, toddlers, and preschool-age children. Furthermore, most of the research 
was conducted previous to the increased expectations of preschool teachers’ skills 
and responsibilities, and studies do not examine the quality and content of courses and 
interactions between preparation and the support early childhood educators experience 
in their jobs. If teacher preparation is included as an element in Quality Counts California, 
the rating scale should include more information, including the number of ECE course 
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credits achieved and whether the training included supervised practice teaching. A rating 
scale, perhaps modeled on the one used in Wisconsin, might be considered. 


Teacher—Child Interactions: CLASS 


In addition to being used in most state QRISs, the CLASS has been used in myriad 
studies in the U.S. and throughout the world. To complete the CLASS, observers watch 
classroom interactions in cycles of 15 to 20 minutes and then give ratings between 1-7 
on 10 items. The items are divided into three subscales: emotional support, classroom 
organization, and instructional supports. 


The authors of the measure reviewed studies showing significant associations 
between dimensions of the CLASS and various child social and academic outcomes 
(Teachstone, 2017). For example, they reported studies in which children in classrooms 
with higher emotional support were rated higher in social competence, were rated lower 
in behavior problems, and performed better on math and literacy assessments. The 
classroom organization dimension has also been linked in a few studies to social, literacy, 
and math skills. And, in a few studies, instructional supports predicted executive functions 
as well as literacy and math skills. As mentioned above, Sabol et al. (2013) reported that, 
of the five individual quality indicators included in the nine states they studied, CLASS 
scores were consistently the strongest predictor of children’s learning. The structural 
quality measures of staff qualifications, staff-to-child ratio, and family partnership provided 
weaker and less consistent predictions of children’s learning. Likewise, a meta-analysis 
of 19 studies of center-based care programs found a modest but significant effect of 
the classroom organization dimension on executive functions and of the instructional 
supports dimension on social skills. 


Despite some findings of significant associations between CLASS scores and child 
outcomes, the evidence is mixed; many studies found no or inconsistent associations (see 
Farran & Nesbitt, 2020). An Organization for Economic Cooperation and Development 
(OECD) summary of studies using the CLASS across many different countries (e.g., in Latin 
America, Europe, and the United States) concluded that “the associations between staff— 
child interactions [measured by the CLASS] and early child cognitive and socio-emotional 
skills and competencies are inconsistent in size ... few studies show strong and consistent 
associations between the commonly studied dimensions (e.g., emotional climate, 
instructional quality and classroom organisation) and any domain of early childhood skills” 
(OECD, 2018, p. 28). Furthermore, even when a study yielded significant findings, the 
associations were typically small and sporadic. One study may have found a significant 
association between a CLASS dimension and a child outcome; another study will not have 
found that same association, but will have found a significant association for that same 
CLASS dimension and a different child outcome, and so on. 
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There is some evidence that variation in CLASS scores above a certain threshold 
may be more strongly associated with child outcomes than variation among lower scores. 
Burchinal et al. (2010) examined associations between scores on the CLASS and child 
outcomes using data from an 11-state preK evaluation. Their findings suggested that the 
quality of teacher—child interactions was a stronger predictor of social competence and 
behavior problems in higher than in lower quality classrooms. In a later study, Burchinal et 
al. (2016) found that the CLASS instructional supports subscale was a stronger predictor 
of the PPVT and WJ-Letter Word scores in higher quality classrooms (above a 2.75 cutoff) 
than in lower quality classrooms. Burchinal et al. (2014) found that classroom organization 
was positively associated with children’s behavior only at the higher range. Similarly, 
Weiland et al. (2013) reported that associations between the CLASS scores and children’s 
executive functions were more consistently found among the higher quality programs. 

In a study by Smith et al. (2008), CLASS summary scores for classroom organization, 
emotional support, and instructional supports were positively associated with the measure 
of cognitive inhibitory control only in the higher range of quality. (CLASS instructional 
support scores were found to be negatively related to the measure of cognitive inhibitory 
control in the lower quality range.) 


Summary and analysis. Although there is some evidence for associations 
between CLASS scores and child outcomes, the significant predictions are typically 
weak and unsystematic. One might expect the classroom organization dimension to 
be the best predictor of child behavior and the instructional supports dimension to 
be the best predictor of literacy and math skills. The evidence does not support such 
correspondences. 


There have been many concerns raised about the reliability of CLASS ratings and 
the particular strategy used to rate classrooms, for example when and for how long the 
observations are conducted. These are issues that could be addressed without major 
changes to the measure itself. 


There is a significant limitation of the CLASS, however, that would require a 
substantial change in the content to address. Tne CLASS items do not map onto the child 
outcomes commonly assessed, particularly executive functions and foundational math 
and literacy skills. Evaluations of curricula indicate that improvement of subject matter 
is achieved through subject-specific teaching. There is some evidence, for example, 
suggesting that there are very specific strategies that teachers can use to promote 
executive functions (Diamond et al., 2007; Raver et al., 2011) and that specific teacher 
behaviors can undermine their development. A recent study by Phillips (2020) found 
that the best negative predictor of executive functions was what the author referred to 
as “red flag” negative behaviors—yelling or cursing at a child, ignoring a child in physical 
or emotional need, physically redirecting or disciplining a child, and using sarcasm or 
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eye-rolling. Also, many studies have demonstrated that domain-specific measures of the 
quality of instruction predict subject matter learning. Evaluations of specific math curricula 
interventions show gains in math skills (e.g., Clements & Sarama, 2008; Schacter et al., 
2016). Evaluations of literacy curricula show that the quality of literacy instruction is related 
to gains in literacy skills (e.g., Bierman et al., 2008; Farver et al., 2009), and studies also 
show that curricula specifically designed to support language development (e.g., Neuman 
& Cunningham, 2009; Wasik & Hindman, 2011) and social-emotional skills (e.g., Fantuzzo 
et al., 2011; Raver et al., 2011) result in gains in those domains respectively. 


The CLASS has only three items related to instruction and they are generic. As 
a consequence, a program could achieve a high score without specific attention to 
the development of executive functions, literacy, or math skills. If these are important 
outcomes, then a classroom observation measure that assesses teaching directly related 
to these outcomes is needed to assess the quality of teaching. 


Practical constraints render difficult the widespread use of an observations measure 
focused on subject matter teaching that is sufficiently nuanced to predict subject matter 
learning. First, observers would need some specialized knowledge in subject matter 
teaching. Second, observations would most likely need to be longer than the time allotted 
for CLASS observations, especially in full-day programs where a particular subject may 
not be taught within the observation window. Third, the measure itself would need to be 
more detailed and thus longer. These challenges are substantial but not insurmountable, 
especially if observations were conducted less often than Quality Counts California 
currently requires. 


The CLASS may be the best of available measures of teacher—child interactions, 
but the evidence of its associations with children’s development on important dimensions 
is not sufficient to justify the cost. There are many reasons to invest in the development 
of an alternative observation measure that is better aligned with the desired effects on 
children’s learning and that could be implemented in California in the future. 


Classroom Environment (ECERS, ITERS, FCCERS) 


The other classroom observation measure included in most QRISs is the ECERS-R. 
The ECERS-R includes 43 items organized into seven subscales (space and furnishings, 
personal care routines, language reasoning, learning activities, interaction, program 
structure, and parent and staff). The ratings are based on a 2- to 3-hour-long observation 
supplemented by teacher interviews. Studies have suggested that subscores group into 
two categories: (a) appropriate activities and materials, and (b) learning interactions (Setdoji 
et al., 2018). The Infant/Toddler Environment Rating Scale-3rd edition (ITERS-3) is designed 
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for infant-toddler programs and the Family Child Care Environment Rating Scale-3rd 
edition (FCCERS-3) is designed for family childcare settings. 


The more recent ECERS-3rd edition (ECERS-3) gives more attention to the 
instructional behavior of teachers, but it has not been used in much research. In a recent 
study, Hestenes et al. (2019) found that ECERS-3 but not ECERS-R scores were significantly 
associated with the education levels of teachers and teacher-to-child ratios, suggesting 
that it might be a more sensitive measure of quality. 


The evidence on the associations between the ECERS-R and developmental 
outcomes for young children is mixed. Some studies have reported weak but positive 
linear associations with preschoolers’ receptive and expressive language skills, applied 
problem-solving skills, and some indices of social-emotional development (e.g., Early et 
al., 2006; Mashburn et al., 2008). Other studies have failed to find significant associations 
between the ECERS-R and these dimensions of children’s developmental outcomes (e.g., 
Sabol & Pianta, 2014; Zellman et al., 2008). A review of research that includes the ECERS-R 
and child outcomes suggests occasional but inconsistent significant associations. Brunsek 
et al. (2017) reviewed 73 studies and examined 16 studies in a meta-analysis. Meta-analyses 
revealed a few (3 out of 17) significant, although weak positive relationships between 
ECERS/ECERS-R total score and language and positive behavior outcomes. The language- 
reasoning subscale was also weakly related to receptive language. 


As was found for the CLASS, there is some evidence for threshold effects, but in 
the case of ECERS-R, the lower range of the scale appears to be a stronger predictor of 
child outcomes. Burchinal et al. (2000) combined data across three large-scale childcare 
studies and, using the quality thresholds defined by the developers of the ECERS, classified 
classrooms into poor (scores of 1.00-2.99), average (scores of 3.00-4.99), or good 
(scores above 5.00) quality groups. Children in the poor-quality group showed more 
behavioral problems and scored lower on verbal, reading, and mathematical problem- 
solving assessments than did children whose classrooms were classified as of average or 
good quality. The average and good groups were not different from each other on child 
outcomes. In another study, variation in the low end of the scale (scores of 1.00 to 3.40) 
was associated with social-emotional outcomes, but variation among scores above 3.40 
was not (Setodji et al., 2018). In a third study, variation in scores in the middle of the scale, 
from 3.40 to 4.60, was significantly associated with children’s receptive and expressive 
anguage and applied mathematical problem-solving skills (Le et al., 2015). In all three 
studies, variation in the upper end of the scale was not associated with child outcomes. 
Researchers have proposed that the leveling off effect is a consequence of the ECERS-R’s 
imited focus on teaching processes and practices. The ECERS-3 was designed to address 
this potential limitation. Tne ECERS-R has also been criticized for its scoring system, which 
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requires an observer to give a rating at the first place where all indicators are not checked, 
precluding programs from getting credit for quality indicators at higher levels. 


Summary and analysis. Findings from both the QRIS validity evaluations and other 
studies suggest weak and inconsistent associations between the ECERS and the child 
outcomes that have been assessed. The ECERS includes a number of subscales (e.g., 
furnishings, personal care routines) that would not be expected to have direct effects on 
children’s developmental outcomes, although they may have value in their own right. Also, 
like the CLASS measure, the ECERS does not assess teacher—child interactions that are 
directly related to the child outcomes typically measured, such as executive functions and 
language, literacy, and math skills. 


Global measures of quality are rarely combined in the same study with more 
domain-specific measures of quality, so there is no direct evidence on their comparative 
value. In the one study that included both a global measure (ECERS) and a subject- 
specific measure (the literacy activities score of the teacher Behavior Rating Scale), the 
subject-specific measure was the stronger predictor of children’s language and literacy 
skills (Burchinal et al., 2016). This finding provides further support for the value of subject- 
specific classroom observations. 


In brief, the ECERS is not clearly predictive of child outcomes. If it is used, there 
need to be other reasons, and they should be sufficiently strong to justify the cost. 


Child-to-Teacher Ratio and Group Size 


Limits on child-to-staff ratios and group size are ubiquitous in state program 
licensing standards and are considered a key index of quality. Lower ratios and group sizes 
are expected to improve child outcomes because they allow teachers to know each child 
better and to devote more time to the needs of individual children. 


A recent review of studies assessing associations between child-to-staff ratios and 
child outcomes for preschool-aged children revealed few significant associations (Perlman 
et al., 2017). The review included 29 studies with child-to-staff ratios ranging from 5 to 
14.5. Only 2 out of 10 studies reported significant associations, with better child-to-staff 
ratios related to better cognitive child outcomes. Of the 12 studies that assessed math 
outcomes, one study reported that low child-to-staff ratios were associated with higher 
math outcomes, and one other study reported that higher child-to-staff ratios predicted 
higher math outcomes. Most of the studies assessing language outcomes showed 
nonsignificant associations with child-to-staff ratios but, as was found for math, those that 
did yield a significant finding were divided between the better outcome being associated 
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with low ratios (four studies) versus high ratios (two studies). Only 4 of the 22 studies that 
examined positive social-emotional outcomes showed a positive effect of lower ratios. 


A review of studies internationally (which included some of the same studies 
in the review summarized above) examined the effects of ratio and group size on 
both quality assessments (e.g., ECERS and CLASS) and child outcomes (OECD, 2018). 
According to the authors, “lower ratios and, to a lesser degree, smaller group size were 
found to be consistently supportive of staff—child relationships across different types of 
settings. However, the evidence for the relationship between smaller ratios and emerging 
academic skills, such as early literacy and early numeracy, was unclear" (p. 11). Despite 
the fairly consistent links between ratios and group sizes and staff—child interactions, 
these structural indicators were not directly linked to child development and learning. 
The review of the literature indicated a mixed pattern of associations both across and 
within countries, and the meta-analysis conducted for this report failed to find significant 
associations between child-to-staff ratios and early literacy and numeracy skills. 


Only one study—the California Staff/Child Ratio Study—involved random 
assignment of children into groups with different ratio levels (Love et al., 1992). Ratios were 
not associated with teacher reports related to social-emotional dimensions (antisocial, 
depressed, attention deficit, and immature/dependent behaviors) after controlling for 
baseline behavior scores. 


One analysis suggested that ratio and group size may only matter below a 
certain level. Bowne et al. (2017) used a comprehensive database of U.S. early childhood 
education program evaluations published between 1960 and 2007 to evaluate the 
relationship between group size, child-to-teacher ratio, and program effect sizes for 
cognitive, achievement, and social-emotional outcomes. All of the programs were for 
children aged 3 to 5 years. There were no significant linear relationships between child-to- 
teacher ratio and group size, entered either individually or in combination, and cognitive 
and achievement outcomes. Instead, both group size and child-to-teacher ratio showed 
nonlinear relationships with cognitive and achievement effect sizes. Child-to-teacher ratios 
were significantly associated with cognitive and achievement outcomes only for ratios 
of 7.5:1 and lower, and for group sizes of 15 and fewer. No discernible relationship was 
found among larger group sizes and child-to-teacher ratios within the range included. 
Results were less clear for social-emotional outcomes due to the small sample size. These 
findings align with prior studies of older children that indicated that child-to-teacher ratios 
need to be very low to have effects on children’s learning (Chingos, 2012; Cho et al., 2012). 


Summary and analysis. The California QRIS validation study showed that children 


who were in programs at QRIS levels 1 or 2 had a modest but significantly lower score 
on the math assessment (mean score of 3.7) compared with children in programs that 
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received 3, 4, or 5 points (mean score of 3.8). A smaller child-to-adult ratio was also 
associated with higher scores on expressive vocabulary in the Rhode Island validation 
study. Looking across studies, however, the evidence for associations between child-to- 
staff ratios is surprisingly weak given the strong belief in their importance in the ECE field. 
One possible reason for the disparity between beliefs and evidence is that the demands on 
teachers are multiplied with each additional child, and one additional child who has poor 
self-regulation can challenge even the best teachers. Moreover, children living below the 
poverty line, some of whom might have experienced physical or emotional trauma in their 
homes or communities, and children with special needs require a great deal of attention. 
English language learners also add to the demands on teachers. Constraining the number 
of children in a classroom most likely reduces the burden on teachers, whether or not it is 
associated with child outcomes. 


Second, the research needs to be interpreted cautiously. The methods used 
for assessing ratios varied. In some studies, the number of adults and children in the 
classroom were counted; others relied on staff reports. Aides, volunteers, and teachers 
were often not differentiated. Three untrained volunteers in a classroom may create a 
very favorable child-to-adult ratio but may not contribute much to children’s learning. 
The effect of child-to-adult ratio should also depend substantially on the training of the 
adults, which is not included in extant research. A teacher, aide, or volunteer who has not 
been trained to manage a group of children may find It hard to be effective even with a 
small number of children. A highly trained teacher who is an effective manager and offers 
productive, engaging learning experiences for children may be able to support learning in 
a much larger group than a teacher with less preparation. International comparisons can 
be misleading, but in countries such as France, preschool teachers have at least 4 years of 
training focused on practice and have been found to be very effective with a child-to-staff 
ratio of 15:1 and a group of as many as 30 children with one aide (OECD, 2018). 


Child-to-staff ratios and training requirements both have major effects on cost. 
California, as with most states in the U.S., has chosen to spend more on keeping ratios 
low and less on preparing teachers and providing concomitant pay than most European 
countries. Research designed to understand the trade-offs between these two variables 
that contribute to cost would be useful. At present, the research supports including only 
variations at the low end of child-to-staff ratios and class size in a QRIS. 


Conclusion 
There may be justifications for particular elements in the QRIS that are not related 


to whether the element is associated with child outcomes. Ensuring health and safety, 
for example, Is important even though it would not be expected to predict children’s 
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social-emotional development, executive functions, or math and literacy skills. And some 
dimensions, such as child-to-adult ratio and group size, may be related to the health and 
well-being of staff, whether or not they are associated with child outcomes. 


This report focuses on one criterion for selecting program dimensions to include 
in a QRIS—whether elements are associated with gains on particular developmental 
dimensions. The present analysis of the QRIS validation studies and other research 
suggests that the current elements in Quality Counts California have weak and 
inconsistent associations with child outcomes. The problem, however, is not necessarily 
with the dimensions measured, but how they are measured and how points are allocated. 


Consider measures of the program environment (ECERS) and teacher—child 
interactions (CLASS). If current measures are used, the evidence suggests that variance 
in particular ends of the scale are more strongly associated with child outcomes. This 
research thus has implications for allocating points. Perhaps points should be added with 
smaller increases in scores at the top of the CLASS scale than at the bottom, and with 
smaller increases In scores at the bottom of the ECERS scale than at the top. The same 
analysis applies to ratio and group size. The evidence suggests that greater validity might 
be achieved by awarding more points for variations in the lower end (e.g., under 7.5 for 
child-to-teacher ratio and under 15 for group size) than for the same differences at the 
higher end. 


The measures themselves, however, should also be reconsidered, in part because 
expectations related to child outcomes have changed, especially in the last decade. 
Historically, Kindergarten was created to teach children how to behave in a school setting 
and preschool (or nursery school, as it was typically called) was designed primarily to 
give children opportunities to develop social skills by interacting with peers. The emphasis 
in kindergarten was on school-related behaviors such as listening to the teacher and 
following directions, and in preschool on child-initiated and cooperative play. 


A glance at the skills in the Common Core kindergarten standards as well as the 
California Preschool Foundations makes it clear that the goals have changed, especially 
regarding the teaching of foundational academic skills. Many early childhood educators 
have challenged the increased emphasis on academics, worried that it will undermine 
children’s motivation to learn and crowd out opportunities to play and to develop 
social skills. The concerns have merit, given evidence that many preschools are using 
worksheets and other didactic, developmentally inappropriate strategies to teach early 
literacy and math. Early introduction to academic skills, however, can be provided in a 
playful, developmentally appropriate way (Stipek, 2017). But doing so requires teachers to 
have considerable skills, such as understanding the individual needs of children (including 
dual language learners and children with special needs); creating and implementing 
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playful activities that lay the foundation for literacy and math skill development and 

the development of executive functions and social skills; assessing children’s progress 
towards meeting the standards; and using that information to adapt instruction. A program 
evaluation system that predicts children’s progress must therefore assess the degree to 
which preschool teachers are prepared to implement effective teaching strategies specific 
to the desired domains of development and whether they actually implement them in 

the programs in which they teach. Current licensing standards in California do not require 
people preparing to become preschool teachers to learn how to teach literacy or math, 
and neither the ECERS nor the CLASS assess literacy or math teaching. 


There are also limitations related to the measures of child outcomes typically used 
in validation studies. For practical reasons, the measures are brief and fairly superficial. 
They do not come close to assessing all of the outcomes included in the California 
Preschool Foundations and brief, superficial measures are not as sensitive to the quality of 
instruction as are more comprehensive measures. If we want to detect the effects of the 
quality of programs, we will have to use better measures of children’s learning. 


Quality Counts California also needs to differentiate between the age of children 
as well as the learning context (e.g., home vs. center). It is not clear that the same set of 
elements should be used for caregivers of infants and toddlers as are used for preschool 
teachers or caregivers of children aged 3 to 5 years. There is overlap, to be sure. For 
example, there is clear evidence that nurturing, sensitive caregiving supports children’s 
development regardless of their age. But while a language-rich environment (including 
math language) is important for children at all ages—and even toddlers can begin to learn 
number concepts (e.g., counting a few objects) and prereading skills—children in the 
5-5 year range are ready for more structured (albeit playful) instruction related to literacy 
and math. These differences in expectations should be reflected in a QRIS. 


California should consider including elements that are not currently part of Quality 
Counts. Some states include elements related to features of the work environment 
(Whitebook et al., 2018). There is some evidence that pay and benefits are associated with 
the quality of care (Phillips et al., 2000; see Phillips et al., 2016). Low salaries, for example, 
are associated with higher rates of teacher stress and depression, which are associated 
with withdrawal as well as with insensitive and intrusive behaviors towards children (Hamre 
& Pianta, 2004; Sandilos et al., 2015; Whitaker et al., 2015). Low pay is also associated with 
teacher turnover, which undermines continuity for children and opportunities for them to 
form secure attachments with caregivers (Whitebook et al., 2014). Teacher turnover itself 
could be considered as a measure of program quality, in addition to pay and benefits. 


Given the evidence on the positive effects of curricula focused on specific domains 
of learning, whether an evidence-based curriculum is used for literacy and math in 
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preschool should be considered. The degree to which teachers are provided training and 
ongoing support in using the curriculum is, however, just as important as its adoption. 


Opportunities to participate in professional development and ongoing support 
for improvement, such as through coaching, are also associated with quality staff—child 
interactions and child outcomes (OECD, 2018). Attention, however, needs to be given to 
the nature of support for quality improvement. One meta-analysis found that interventions 
that included coaching were up to three times more effective than interventions that 
included in-service training but no coaching (OECD, 2018). But even within coaching there 
is wide variation in quality, making it important to implement some kind of quality control 
system. 


Policy Implications 


This review focused only on CA-QRIS's ability to predict child outcomes. The 
policy implications accordingly only apply if that is a central goal of the QRIS. The weak 
and inconsistent findings of the research reviewed here suggest that substantial work 
needs to be done before QRIS ratings can be expected to predict children’s learning and 
development consistently. The following strategies are suggested to move Quality Counts 
California towards a valid assessment of program quality. 


1. An investment needs to be made in developing a classroom observation 
measure that is better aligned with desired child outcomes. 


2. Research designed to validate the QRIS needs to include more comprehensive 
measures of children’s literacy and math skills than are currently used. 


3. Amore nuanced measure of teacher qualifications, including the nature and 
extent of courses in ECE and supervised practice teaching should be created. 


4. California should investigate alternative variables to include in its QRIS that are 
associated with quality, such as staff pay, staff reports of working conditions, the 
implementation of research-based curricula, and opportunities for high-quality 
professional development. 


5. Adjustments should be made to ensure the appropriateness of quality ratings for 
children of different ages and in different settings. 


6. Studies should examine different rating rubrics and different cutoff scores for 
awarding points to determine which strategies are the most predictive of child 
outcomes. Cutoffs for awarding points should be informed by extant research 
on the measures used. 
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1. Child Observation 


2. Developmental and Health 
Screenings 


3. Minimum Qualifications 
for Lead Teacher/ Family 
Child Care Home (FCCH) 


4. Effective Teacher-Child 
Interactions: CLASS 


Assessments (‘Use tool for 
appropriate age group as available) 


CALIFORNIA QUALITY RATING AND IMPROVEMENT SYSTEM (CA-QRIS) 
QUALITY CONTINUUM FRAMEWORK -RATING MATRIX WITH ELEMENTS AND POINTS FOR CONSORTIA COMMON TIERS 1, 3, AND 4 


O Not required 


O Meets Title 22 Regulations 


O Meets Title 22 Regulations 
[Center: 12 units of Early 
Childhood Education 
(ECE)/Child Development (CD) 
FCCH: 15 hours of training on 
preventive health practices] 


0 Not Required 


O Program uses evidence- 
based child 
assessment/observation tool 
annually that covers all five 
domains of development 
O Health Screening Form 
(Community Care Licensing form 
LIC 701 "Physician's Report - 
Child Care Centers" or 
equivalent) used at entry, then: 
1. Annually 
OR 
2. — Ensures vision and 
hearing screenings 
are conducted 
annually 


O Program uses valid and 
reliable child assessment/ 
observation tool aligned with 
CA Foundations & 
Frameworks" twice a year 

O Program works with families 
to ensure screening of all 
children using a valid and 
reliable developmental 
screening tool at entry and as 
indicated by results thereafter 
AND 

O Meets Criteria from point 
level 2 


CORE II: TEACHERS AND TEACHING 


O Center: 24 units of ECE/CD2 
OR Associate Teacher Permit 
O FCCH: 12 units of ECE/CD 
OR Associate Teacher Permit 


O Familiarity with CLASS for 
appropriate age group as 
available by one representative 
from the site 


0 24 units of ECE/CD + 16 
units of General Education 
OR Teacher Permit 

AND 

0 21 hours professional 
development (PD) annually 


O Independent CLASS 
assessment by reliable 
observer to inform the 
program's professional 
development/improvement plan 


CORE |: CHILD DEVELOPMENT AND SCHOOL READINESS 


0 DRDP (minimum twice a 
year) and results used to 
inform curriculum planning 


O Program works with 
families to ensure screening 
of all children using the ASQ 
at entry and as indicated by 
results thereafter 

AND 

O Meets Criteria from point 
level 2 


D Associate's degree 

(AAJAS) in ECE/CD (or 

closely related field) OR 

AAJAS in any field plus 24 

units of ECE/CD 

OR Site Supervisor Permit 

AND 

O01 21 hours PD annuall 

O Independent CLASS 

assessment by reliable 

observer with minimum 

CLASS scores: 

Pre-K 

= Emotional Support - 5 

= Instructional Support -3 

= Classroom Organization - 5 

Toddler 

= Emotional & Behavioral 
Support - 5 


O Program uses DRDP twice a year and 
uploads into DRDP Tech and results 
used to inform curriculum planning 


O Program works with families to ensure 
screening of all children using the ASQ & 
ASQ-SE, if indicated, at entry, then as 
indicated by results thereafter 

AND 

O Program staff uses children’s 
screening results to make referrals and 
implement intervention strategies and 
adaptations as appropriate 

AND 

O Meets Criteria from point level 2 


O Bachelor's degree in ECE/CD (or 
closely related field) OR BA/BS in any 
field plus/with 24 units of ECE/CD 

(or master's degree in ECE/CD) 

OR Program Director Permit 

AND 

0 21 hours PD annually 


O1 Independent assessment with CLASS 
with minimum CLASS scores: 

Pre-K 

= Emotional Support - 5.5 

= Instructional Support - 3.5 

= Classroom Organization - 5.5 


Toddler 

= Emotional & Behavioral Support - 5.5 
= Engaged Support for Learning - 4 
Infant 

= Responsive Caregiving (RC) - 5.5 


1. Approved assessments are: Creative Curriculum GOLD, Early Learning Scale by National Institute of Early Education Research (NIEER), and Brigance Inventory of Early Development III. 


2. For all ECE/CD units, the core eight are desired but not required. 
Note: Point values are not indicative of Tiers 1-5 but reflect a range of points that can be earned toward assigning a tier rating (see Total Point Range). 
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= Engaged Support for 
Learning - 3.5 

Infant 

= Responsive Caregiving 
(RC) - 5.0 


CORE Ill: PROGRAM AND ENVIRONMENT - Administration and Leadership 


5. Ratios and Group Size 


(Centers Only beyond licensing 
regulations) 


O Center: Title 22 Regulations 
Infant Ratio of 1:4 

Toddler Option Ratio of 1:6 
Preschool Ratio of 1:12 
OFCCH: Title 22 Regulations 
(excluded from point values in 
ratio and group size) 


O Center - Ratio: Group Size 


Infant/Toddler - 4:16 
Toddler - 3:18 
Preschool - 3:36 


O Center - Ratio: Group Size 


Infant/Toddler- 3:12 
Toddler — 2:12 
Preschool- 2:24 


O Center - Ratio: Group 
Size 


Infant/Toddler - 3:12 or 2:8 
Toddler — 2:10 
Preschool — 3:24 or 2:20 


O Center - Ratio: Group Size 


Infant/Toddler — 3:9 or better 

Toddler — 3:12 or better 

Preschool - 1:8 ratio and group size of 
no more than 20 


6. Program Environment 


Rating Scale(s) (Use tool for 
appropriate setting: ECERS-R, ITERS- 
R, FCCERS-R) 


O1 Not Required 


O Familiarity with ERS and 
every classroom uses ERS as a 
part of a Quality Improvement 
Plan 


O Assessment on the whole 
tool. Results used to inform the 
program's Quality Improvement 
Plan 


1 Independent ERS 
assessment. All subscales 
completed and averaged to 
meet overall score level of 5.0 


O Independent ERS assessment. All 
subscales completed and averaged to 
meet overall score level of 5.5 

OR 

Current National Accreditation approved 
by the California Department of 
Education 


7. Director Qualifications 


(Centers Only) 


0 12 units ECE/CD+ 3 units 
management/ administration 


0 24 units ECE/CD + 16 units 
General Education +/with 3 units 
management! 

administration 


OR Master Teacher Permit 


O Associate's degree with 24 
units ECE/CD +/with 6 units 
management/ 

administration and 2 units 
supervision 

OR Site Supervisor Permit 
AND 


O Bachelor's degree with 24 
units ECE/CD +/with 8 units 
management/ 

administration 

OR Program Director Permit 
AND 

O 21 hours PD annually 


O Master's degree with 30 units ECE/CD 
including specialized courses +/with 8 
units management/ 

administration, 

OR Administrative Credential 

AND 

O 21 hours PD annually 


O 21 hours PD nes 


Program Type Common-Tier 1 Local-Tier 23 Common-Tier 3 Common-Tier 4 Local-Tier 54 
Centers / Blocked (7 points) - Must Meet Point Range Point Range Point Range Point Range 
7 Elements for 35 points All Elements 8 to 19 20 to 25 26 to 31 32 and above 
FCCHs / Blocked (5 points) - Must Meet Point Range Point Range Point Range Point Range 
5 Elements for 25 points All Elements 6 to 13 14 to 17 18 to 21 22 and above 


3. Local-Tier 2: Local decision if Blocked or Points and if there are additional elements. 
4. Local-Tier 5: Local decision if there are additional elements included California Department of Education, February 2014 updated on May 28, 2015; effective July 1, 2015. 
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Policy Analysis for California Education (PACE) 


Improving education policy and practice and advancing equity 
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PACE Is an independent, non-partisan research center led by faculty directors at 
Stanford University, the University of Southern California, the University of California 
Davis, the University of California Los Angeles, and the University of California 
Berkeley. Founded in 1983, PACE bridges the gap between research, policy, and 
practice, working with scholars from California’s leading universities and with 

state and local decision makers to achieve improvement in performance and 
more equitable outcomes at all levels of California's education system, from early 
childhood to postsecondary education and training. We do this through: 


ey bringing evidence to bear on the most critical issues facing Our state; 
€ making research evidence accessible; and 


G leveraging partnership and collaboration to drive system improvement. 
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Phone: (650) 724-2832 
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